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DETAILED ACTION 



Information Disclosure Statement 

1 . Applicants' Information Disclosure Statement, filed 31 March 2003, has been 
received, entered into the record, and considered. See attached form PTO-1449. 

Preliminary Amendment 

2. Applicants' Preliminary Amendment, filed 15 April 2003, has been received, 
entered into the record, and considered. 

3. The amendment amended claims 1 and 3-5 to clearly recite the claimed 
embodiments. 



4. The disclosure is objected to because it contains an embedded hyperlink and/or 
other form of browser-executable code at page 4, line 8 of the Specification (i.e., 
FFTW.ORG). Applicant is required to delete the embedded hyperlink and/or other form 
of browser-executable code. Alternatively, Applicant may place angle brackets (i.e., <>) 
around the hyperlink to overcome the objection. SeeMPEP§ 608.01. 



Specification 
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Drawings 

5. The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. Therefore, the following must be 
shown or the feature(s) canceled from the claim(s). No new matter should be entered. 

a) . Frequency representation comprises a Fast Fourier Transform. 

b) . Obtaining said first frequency representation comprises performing a 
Discrete Fourier transform. 

Corrected drawing sheets are required in reply to the Office action to avoid 
abandonment of the application. Any amended replacement drawing sheet should 
include all of the figures appearing on the immediate prior version of the sheet, even if 
only one figure is being amended. The figure or figure number of an amended drawing 
should not be labeled as "amended." If a drawing figure is to be canceled, the 
appropriate figure must be removed from the replacement sheet, and where necessary, 
the remaining figures must be renumbered and appropriate changes made to the brief 
description of the several views of the drawings for consistency. Additional replacement 
sheets may be necessary to show the renumbering of the remaining figures. The 
replacement sheet(s) should be labeled "Replacement Sheet" in the page header (as 
per 37 CFR 1 .84(c)) so as not to obstruct any portion of the drawing figures. If the 
changes are not accepted by the examiner, the applicant will be notified and informed of 
any required corrective action in the next Office action. The objection to the drawings 
will not be held in abeyance. 
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Claim Rejections - 35 USC § 102 

6. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

7. Claims 1-8 are rejected under 35 U.S.C. 102(e) as being anticipated by Bolle et 
al. ("Bolle") (U.S. Patent 6,675,174 B1). 

Regarding claim 1 , Bolle teaches a method of providing an identifier for a file, 
said method comprising: 

a) . 'accessing said file' as the detection system takes as input one or more 
temporal digital target media sources M stored on media source (col. 9, lines 63-65); 

b) . 'deriving a frequency representation of said file' as generating a 
representation of the reference media segments in S by performing a key-framing 
process (col. 11, lines 1-9; Figs 4A-4B and 5); 

c) . 'providing a file name for said file* as the recognition or search process 
generates the domain and feature codes (i.e., filename) for the present key interval Ot 
of the target media stream M (i.e., file)(col. 23, lines 9-12); 

d) . 'providing said file name in a directory' as the domain and feature 
codes (i.e., filename) that are computed from a media interval and these codes are 
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stored in different structures such as a tree structure, a graph structure, and table 
structure etc... (i.e., directory) (col. 18, lines 11-15); 

e). 'associating said frequency representation of said file with said file 
name so that said frequency representation is searchable within said directory' as 

from each key interval, a set of features is extracted from a number of regions in the key 
intervals. These regions can be different for each feature and are indexed by domain 
codes. The representations (i.e., pairs of feature and domain) for the different reference 
media segments Si are stored in a segment index table (col. 7, lines 57-65; col. 1 1 , lines 
21-23; Fig. 3) 

Regarding claim 2, Bolle further teaches wherein said 'frequency 
representation comprises a Fast Fourier Transform' as audio signatures are also 
computed by utilizing the fast Fourier transform. The audio signatures are handled 
similarly to the video signatures (col. 5, lines 56-57). 

Regarding claim 3, Bolle further teaches 'configuring an address listing with 
an identifier for said frequency representation serving as metadata in said 
address listing' as the domain code, feature code (i.e., metadata) are populated by 
segment identifier of the corresponding set of code pairs. These pairs are used to 
populate segment index table (i.e., address listing) (col. 8, lines 1-3; col. 7, lines 57-65; 
col. 11, lines 21-23; Fig. 3). 
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Regarding claim 4, Bolle teaches a method of searching for a video file, said 
method comprising: 

a) . 'obtaining a first frequency representation of a desired video file' as 

the domain and feature codes that are computed from a media interval and these codes 
are stored in different structures such as a tree structure, a graph structure, and table 
structure etc... for later retrieval. A search algorithm uses the segment index table (i.e., 
obtain desired frequency representation) for measuring the similarity between each of 
the reference media segments and sections of the target media stream (col. 18, lines 
11-15; col. 10, lines 5-11); 

b) . 'accessing a first unknown file' as the recognition phase recognizes 
known media segments in the input target stream by processing the input stream to 
extract features and using the segment index table (col. 9, lines 45-48); 

c) . 'obtaining a second frequency representation of said unknown file' 
as generating a representation of the reference media segments in stream S by 
performing a key-framing process (col. 11, lines 1-9; Figs 4A-4B and 5); 

d) . 'comparing said first frequency representation with said second 
frequency representation' as a target media stream M is compared to the known set 
of reference media segments S (col. 21, line 61 - col. 22, line 4 ); and 

e) . 'determining from said comparing whether said unknown file is said 
desired video file' as taking the domain and feature codes and searching for 

matches in the segment index table T. The result of the search process is the winner 
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table comprises a list of top L key intervals of the reference segments that best match 
the target media key interval under consideration at Ot (col. 23, lines 45-52). 

Regarding claim 5, Bolle further teaches wherein said 'obtaining said first 
frequency representation of said desired video file comprises performing a Fast 
Fourier Transform algorithm' as audio signatures are also computed by utilizing the 
fast Fourier transform. The audio signatures are handled similarly to the video 
signatures (col. 5, lines 56-57). 

Regarding claim 6, Bolle further teaches wherein said 'obtaining said first 
frequency representation comprises performing a Discrete Fourier Transform' as 

for each interval, the discrete Fourier transform is computed which gives a discrete 
function |F(s)| (col. 17, lines 37-40). 

Regarding claim 7, Bolle further teaches wherein said 'comparing said first 
frequency representation with said second frequency representation comprises 
comparing a range of frequencies of said first and second frequency 
representations' as step 1205 in the search process which sets the range of reference 
segment key intervals to be searched in the segment index table. This ensures that all 
the key intervals in the segment index table are matched against each of the key 
interval extracted from the target media stream (col. 23, lines 45-52; col. 24, lines 21-25 
and lines 31-34). 
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Regarding claim 8, Bolle further teaches 'decoding said unknown file' as the 

incoming media stream could potentially be in any format, depending on the format of 
the media, it is processed through the corresponding decoder (col. 22, lines 44-60). 

8. Claims 9-10, 14-15, and 17-18 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Burrows (U.S. Patent Applicant US 20020049753A1 ). 

Regarding claim 9, Burrows teaches a method of determining redundancies in a 
content object directory, said method comprising: 

a) . 'accessing a plurality of files stored on a memory, wherein each of 
said files is configured so as to be identified by a fingerprint' as parsing a current 
page to determine the fingerprint of the current page (fls 378 and 379); 

b) . 'for each of said files, determining said fingerprint' as parsing a 
current page to determine the fingerprint of the current page fl|s 378 and 379) ; 

c) . 'establishing a redundancy standard so as to indicate whether any 
two of said fingerprints of said files are redundant of one another 1 as a duplicate 
page is defined as a page having a different URL address, but having identical 
fingerprint as a previously indexed master page flj 379, lines 1-3); 

d) . 'comparing said fingerprints determined for each of said files' as 
compare the fingerprint of the current page with the fingerprints of previously indexed 
pages flf 381 , lines 3-5); 
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e). 'determining redundant files based upon said comparing said 
fingerprints and said redundancy standard' as if there is no identical fingerprint entry 
in the index, then the current page is different. Otherwise, if the current page is a 
duplicate, then generate the pairs [location, fingerprint], and [location, address] (fl 382, 
lines 1-2 and 4-5). 

Regarding claim 10, Burrows further teaches 'deleting at least one redundant 
file from said memory' as determine if the page (i.e., file) to be deleted is a master 
page. If true, then generate a reissue request. Otherwise, determine if the page to be 
deleted is the next recorded duplicate of the page to be deleted and there is no master 
page proceed with step 2520 (Us 383 and 384 and Fig. 25). 

Regarding claim 14, Bolle further teaches wherein said accessing a plurality of 
files comprises 'accessing a plurality of files comprising video data' as the pages 
can encode multimedia items including digitized graphic, audio or video components (U 
0071). 

Regarding claim 15, Bolle further teaches wherein said accessing a plurality of 
files comprises 'accessing a plurality of files comprising audio data' as the pages 
can encode multimedia items including digitized graphic, audio or video components flj 
0071). 
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Regarding claim 17, Burrows further teaches 'appending a fingerprint as 
metadata to at least one directory listing' as a search in the index for the metaword 
which expresses the value of the fingerprint fl|381 ). 

Regarding claim 18, Burrows further teaches 'cataloging in a database said 
fingerprint with the file from which said fingerprint was generated' as index of the 
database can be search for the metaword which expresses the value of the fingerprint 
(lis 101, 122 and 381). 

Claim Rejections - 35 (JSC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 1 03(a). 
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10. Claims 11 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Burrows (U.S. Patent Applicant US 20020049753A1 ) as applied to claims 9-10, 
14-15, and 17-18 above and in view of Bolle et al. ("Bolle") (U.S. Patent 6,675,174 B1). 

Regarding claim 1 1 , Burrows does not explicitly teach utilizing a Fast Fourier 
Transform algorithm to compute said fingerprint. 

Bolle, however, teaches 'utilizing a Fast Fourier Transform algorithm to 
compute said fingerprint' as audio signatures are also computed by utilizing the fast 
Fourier transform. The audio signatures are handled similarly to the video signatures 
(col. 5, lines 56-57; col. 17, lines 30-31). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to combine the teachings of the cited references because Bolle's 
teaching would have allowed Burrows's to compute audio or video signatures to 
identify the content for each video segment or audio signal in order to perform similarity 
match to recognize known media segments in the input target stream as suggested by 
Bolle at col. 9, lines 45-48; col. 7, lines 18-22. 

Regarding claim 16, Burrows does not explicitly teach establishing a 
redundancy standard comprises determining a range of frequencies in a pattern of 
frequencies from a Fast Fourier Transform for comparison of said fingerprints. 
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Bolle, however, teaches wherein said 'establishing a redundancy standard 
comprises determining a range of frequencies in a pattern of frequencies from a 
Fast Fourier Transform for comparison of said fingerprints' as step 1205 in the 
search process which sets the range of reference segment key intervals to be searched 
in the segment index table (col. 23, lines 45-52; col. 24, lines 21-25 and lines 31-34). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to combine the teachings of the cited references because Bolle's 
teaching would have allowed Burrows's to ensure that all the key intervals in the 
segment index table are matched against each of the key interval extracted from the 
target media stream as suggested by Bolle at col. 23, lines 32-35. 

1 1 . Claims 12 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Burrows (U.S. Patent Applicant US 20020049753A1 ) as applied to claims 9-10, 
14-15, and 17-18 above and in view of Rhoads et al. ("Rhoads") (U.S. Patent 
Application 2002/0032864 A1). 

Regarding claim 12, Bolle does not explicitly teach utilizing a watermark as said 
fingerprint. 

Rhoads, however, teaches 'utilizing a watermark as said fingerprint' as 

watermark can convey a fingerprint and auxiliary data as well fl| 0029 to 0033, and 
0036). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to combine the teachings of the cited references because 
Rhoads's teaching would have allowed Burrows's to improve the efficiency and cost of 
the detecting system by using the embedded fingerprint data or watermark for each 
frame to allow a streaming system to check the song for identification and if that 
identification is absent or not authenticated, the system can check for the watermark 
and/or calculate the fingerprint as suggested by Rhoads at 1J0036. 

Regarding claim 13, Bolle does not explicitly teach utilizing cyclical redundancy 
check data as said fingerprint. 

Rhoads, however, teaches 'utilizing cyclical redundancy check data as said 
fingerprint' as the fingerprint data or watermark data stored in the header may be 
encrypted and/or authenticated by a digital signature such as a complete hash, or a few 
check bits or cyclical redundancy check (CRC) bits fl] 30). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to combine the teachings of the cited references because 
Rhoads's teaching would have allowed Burrows's to enable encryption of the 
fingerprint data to provide added security by utilizing a digital signature such as CRC 
bits as suggested by Rhoads at ^ 30, lines 1-4 and 31. 
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Conclusion 

12. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. Patent 6,424,725 B1 issued to Rhoads et al. on 23 July 2002. The subject 
matter disclosed therein is pertinent to that of claims 2, 11, and 12 (e.g., Fourier 
transform and watermark embedding into digital media content). 

U.S. Patent 6,006,245 A issued to Thayer on 21 December 1999. The subject 
matter disclosed therein is pertinent to that of claims 2 and 1 1 (e.g., Fast Fourier 
transform). 

U.S. Patent 5,918,223 A issued to Blum et al. on 29 June 1999. The subject 
matter disclosed therein is pertinent to that of claims 1-3, 4, 9, and 15 (e.g., comparison 
of audio files). 

U.S. Patent 6,226,391 B1 issued to Dydyk et al. on 01 May 2001 . The subject 
matter disclosed therein is pertinent to that of claims 1 and 4 (e.g., frequency 
representation of an image). 
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U.S. Patent 6,748,360 B2 issued to Pitman et al. on 08 June 2004. The subject 
matter disclosed therein is pertinent to that of claims 1-2 (e.g., audio content 
identification). 

U.S. Patent 6,647,128 B1 issued to Rhoads et al. on 1 1 November 2003. The 
subject matter disclosed therein is pertinent to that of claims 12, 14-15 (e.g., digital 
watermarked data for image, video or audio files). 

U.S. Patent 2001/0053236 A1 published on 20 December 2001 . The subject 
matter disclosed therein is pertinent to that of claims 12, 14-15 (e.g., audio video 
steganography). 

U.S. Patent 20020082731 A1 published on 27 June 2002. The subject matter 
disclosed therein is pertinent to that of claims 1-3, 4, 9, and 15 (e.g., Fast Fourier 
transform, audio content in video broadcast). 

U.S. Patent 20020083060 A1 published on 27 June 2002. The subject matter 
disclosed therein is pertinent to that of claims 1-3, 6-8, 9-11, and 15-18 (e.g., Fast 
Fourier transform, fingerprint, landmark, recognizing an audio sample locates an audio 
file that most closely matches the audio sample from database indexing). 



Application/Control Number: 10/002,290 Page 16 

Art Unit: 2177 

Chua et al., Content-based Retreival of Segmented Images, ACM, published 
1994. The subject matter disclosed therein is pertinent to that of claims 1, 4, and 9 
(e.g., color texture indices). 

Pfeiffer et al., Automatic Audio Content Analysis, ACM, published 1996. The 
subject matter disclosed therein is pertinent to that of claims 1-3, 6-8, 9-11, and 15-18 
(e.g., Fast Fourier transform, audio content analysis). 

Srinivasan et al., Towards robust Features for Classifying Audio in the CueVideo 
System, ACM published 1999. The subject matter disclosed therein is pertinent to that 
of claims 1 -3, 6-8, 9-1 1 , and 1 5-1 8 (e.g. , Fast Fourier transform, classifying audio in the 
CueVideo). 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Leslie Wong whose telephone number is (703) 305- 
3018. The examiner can normally be reached on Monday to Friday 9:30am - 6:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John E Breene can be reached on (703) 305-9790. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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Patent Examiner 
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